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INTRODUCTION 


In the spring of 1989 a three-site trial network of Volatile Organic Compounds (VOC) samplers 
was initiated. This network has grown substantially and now the Volatile Organic Compounds 
Monitoring Network consists of 14 sites across the province collecting samples on a 1 in 12 day 
schedule. 


As part of the quality assurance efforts for the network, a roving duplicate sampler has been 
used to determine the reproducibility of the sampling and analytical methods. This report 
presents results for the calendar year 1991 when the duplicate sampler was installed in 
downtown Hamilton. 


Specific details of the program and ambient air data listings are available elsewhere!??#*. 


DATA SCREENING 


Data screening procedures are detailed in the ambient air data listing reports. However, the data 
used in this report have been subject to further screening. First; all samples for which the volume 
is less than 34.2 L or greater than 37.8 L have been removed. These limits correspond to a 
variation in flow rate of + 5%, a realistic target if the flow controller is working properly. More 
likely, samples are rejected because of sampler failure (leading to a sample volume of only a few 
litres) or a timer problem (e.g. not shutting off the sampler after 24 hours). 


Second; all results reported as <W have been replaced with 2 the W value. This practice has 
been shown to be not significantly different from various other "backfill" techniques provided 
less than 80% of the sample is reported as non-detects®. If more than 80% of the results for a 
specific compound are reported as <W then that compound is not included in the analysis. 


Ontario Ministry of the Environment Volatile Organic Compounds Monitoring Network 
Standard Operating Procedures and Technical Manual. Air Resources Branch Report # 
ARB-224-89, January 1990. 


Volatile Organic Compounds Monitoring Network Quality Assurance Plan. Air Resources 
Branch Report # ARB-021-90. 


* Volatile Organic Compounds Monitoring Network Ambient Air Concentration Data 
Listing 1989. Air Resources Branch Report # ARB-105-92. 


* Volatile Organic Compounds Monitoring Network Ambient Air Concentration Data 
Listing 1990. Air Resources Branch Report # ARB-106-92. 


> Volatile Organic Compounds Monitoring Network Ambient Air Concentration Data 
Listing 1991. Air Resources Branch Report # ARB-113-92. 


6 Steer, P. and G. Diamond. A proposal for handling non-detects in air monitoring data. 
Memorandum to the Windsor Air Toxics Study Technical Committee dated November 
277 1991. 


RESULTS 


The following compounds were never detected by either sampler: 1,1,2-trichloroethane (vinyl 
trichloride), chlorobenzene (phenyl chloride), 1,3-dichlorobenzene (m-dichlorobenzene), 1,2- 
dibromoethane (ethylene dibromide), and vinyl chloride (chloroethylene). An additional nine 
compounds were not detected more than 80% of the time. Table I shows the compound with the 
appropriate "W" value (1g/m°), the number of samples, the number of non-detects (nd), and the 
maximum result (1g/m°) from both sampler A and sampler B. [See Appendix A for a table of 
compound names and synonyms. Excluded are those compounds listed above.] 


TABLE I. Compounds not detected more than 80% of the time. 
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1,1-Dichloroethane : 0.1 
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Figure | shows scatter plots of results from sampler A vs results from sampler B for compounds 
detected more than 20% of the time. The plots are arranged in order from lower to higher boiling 
point and non-chlorinated to chlorinated VOC (the 1:1 line is also shown). Generally, there is 
least scatter about the 1:1 line for higher concentrations of non-chlorinated VOC. More scatter 
about the 1:1 line is apparent for concentrations closer to the detection limit and for chlorinated 
VOC (the exception is tetrachloroethylene). Identification and quantitation of chlorinated VOC 
is poorer with a flame ionization detector (FID) than with a mass selective detector (MSD). The 
FID was used for this study. Note also that most of the compounds that are routinely not 
detected by either sampler are chlorinated (Table J). 
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Three methods were used to compare results from the two identical samplers. The first method 
provides a measure of agreement (G) and is based upon the following conditions: 


A) The result of the comparison should be a number between 0 and 100% where 100% 
represents complete agreement and 0% represents no agreement. 

B) To accomplish (A) the result should be normalized in some manner; and 

C) Since the samplers are indistinguishable and, in all likelihood, the samples may be 


confused from time to time, the comparison result should not depend on which sampler 
is arbitrarily defined as "independent" (Diamond, pers. comm.): 


where A is the concentration of the analyte from the first sampler and B is the concentration of 
the analyte from the second sampler. Because this method provides a measure of agreement, 
numbers closer to 100 indicate better sampler performance. 


The median absolute difference also gives an indication of the overall precision of collocated 
samplers: 


Median | A-B | 
Median A+B 


* 100 


where A and B are as previously defined. Note that this method yields difference (or 
disagreement) and thus numbers closer to zero indicate better sampler performance. 


The third method of comparison used was the Wilcoxon signed rank test. This test is similar to 
the sign test, however, the signed rank test takes into account the magnitude of the difference 
between results rather than just the sign of the difference. At a 95% confidence level (a = 0.05) 
the computed test statistic Z must be < 1.96 to accept the null hypothesis that there is no 
difference in the distributions of the two samples. The « value is the chance (5%) of incorrectly 
rejecting the null hypothesis (concluding that the samples are different when in fact they are not, 
a Type | error). 


Results from all three tests are presented in Table Il on the following page. For the median 
percent agreement and the median absolute difference cells are shaded if the compound falls 
outside an "acceptability" cut-off of + 25% (ie. 75% agreement or 25% disagreement). If the 
Wilcoxon test statistic is larger than 1.96 the cell is shaded. This indicates that the null hypothesis 
of similar sample distributions must be rejected; i.e. the samples come from different 
populations. Note that as the Wilcoxon test statistic approaches 0 the probability of equalling or 
exceeding the test statistic approaches 1. Note also that this test ignores tied pairs so the result 
for, say, naphthalene (12 tied pairs out of 15 total pairs) will be less meaningful than that for, 
say, benzene (2 tied pairs out of 16 total pairs). 


Compounds for which the median percent agreement is 100.0 or the median absolute difference 
is 0 Ü are those compounds for which the results are predominantly non-detects but not at the 
80% level. Remember that compounds not detected more than 80% of the time are listed in Table 
|. Chloromethane and 1,3-butadiene tended to be not detected or detected at very low levels on 
one sampler but not the other and this causes poor comparability in the median absolute 
difference test and a low percent agreement in the median percent agreement test. It is for a 
similar reason that trichloromethane fails the Wilcoxon test. Bear in mind that the median 
percent agreement or disagreement is presented here; a somewhat less contradictory outcome 
for chloromethane, 1,3-butadiene, and trichloromethane might occur if the average were used 
rather than the median. 


TABLE I. Compound specific results from three comparison tests. Median percent agreement, 
median absolute difference, and the Wilcoxon signed rank test. 
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CONCLUSIONS 


The methods for comparison used in this analysis give a measure of the overall precision of the 
VOC sampling method; i.e. the analytical stage is not separated from the sampling stage. The 
results presented above suggest that the precision of the VOC sampling/analytical method is 
very good. In future, the analytical finish will be by MSD and better identification and lower 
detection limits are expected. Although the precision of the method will drop for some 
chlorinated compounds and those compounds that are at or only slightly above current detection 
levels, the numbers should be more meaningful since the number of non-detects reported should 


3 


be fewer. The most obvious effect will be on the following compounds for which the median 
percent agreement or median absolute difference is already 100.0 or 0.0: naphthalene, 
dichloromethane, styrene, trichloromethane, isoprene, and bromodichloromethane. 


FIGURE 1. Scatter plot of concentration results from Sampler A vs Sampler B. 
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